Applied Metaphors: Learning TRIZ, Complexity, Data/Stats/ML using Metaphors
  1. Teaching
  2. Data Analytics for Managers and Peasants
  3. Descriptive Analytics
  4. Counts
  • Teaching
    • Data Analytics for Managers and Peasants
      • Tools
        • Introduction to R and RStudio
        • Introduction to Radiant
        • Introduction to Orange
      • Descriptive Analytics
        • Data
        • Summaries
        • Counts
        • Quantities
        • Groups
        • Densities
        • Groups and Densities
        • Change
        • Proportions
        • Parts of a Whole
        • Evolution and Flow
        • Ratings and Rankings
        • Surveys
        • Time
        • Space
        • Networks
        • Experiments
        • Miscellaneous Graphing Tools, and References
      • Statistical Inference
        • 🧭 Basics of Statistical Inference
        • 🎲 Samples, Populations, Statistics and Inference
        • Basics of Randomization Tests
        • 🃏 Inference for a Single Mean
        • Inference for Two Independent Means
        • 🃏 Inference for Comparing Two Paired Means
        • Comparing Multiple Means with ANOVA
        • Inference for Correlation
        • 🃏 Testing a Single Proportion
        • 🃏 Inference Test for Two Proportions
      • Inferential Modelling
        • Modelling with Linear Regression
        • Modelling with Logistic Regression
        • 🕔 Modelling and Predicting Time Series
      • Predictive Modelling
        • 🐉 Intro to Orange
        • ML - Regression
        • ML - Classification
        • ML - Clustering
      • Prescriptive Modelling
        • 📐 Intro to Linear Programming
        • 💭 The Simplex Method - Intuitively
        • content/courses/Analytics/Prescriptive/Modules/30-SimlexMethodExcel/index.qmd
      • Workflow
        • Facing the Abyss
        • I Publish, therefore I Am
      • Case Studies
        • Demo:Product Packaging and Elderly People
        • Ikea Furniture
        • Movie Profits
        • Gender at the Work Place
        • Heptathlon
        • School Scores
        • Children’s Games
        • Valentine’s Day Spending
        • Women Live Longer?
        • Hearing Loss in Children
        • California Transit Payments
        • Seaweed Nutrients
        • Coffee Flavours
    • R for Artists and Managers
      • 🕶 Lab-1: Science, Human Experience, Experiments, and Data
      • Lab-2: Down the R-abbit Hole…
      • Lab-3: Drink Me!
      • Lab-4: I say what I mean and I mean what I say
      • Lab-5: Twas brillig, and the slithy toves…
      • Lab-6: These Roses have been Painted !!
      • Lab-7: The Lobster Quadrille
      • Lab-8: Did you ever see such a thing as a drawing of a muchness?
      • Lab-9: If you please sir…which way to the Secret Garden?
      • Lab-10: An Invitation from the Queen…to play Croquet
      • Lab-11: The Queen of Hearts, She Made some Tarts
      • Lab-12: Time is a Him!!
      • Iteration: Learning to purrr
      • Lab-13: Old Tortoise Taught Us
      • Lab-14: You’re are Nothing but a Pack of Cards!!
    • ML for Artists and Managers
      • 🐉 Intro to Orange
      • ML - Regression
      • ML - Classification
      • ML - Clustering
      • 🕔 Modelling Time Series
    • TRIZ for Problem Solvers
      • I am Water
      • I am What I yam
      • Birds of Different Feathers
      • I Connect therefore I am
      • I Think, Therefore I am
      • The Art of Parallel Thinking
      • A Year of Metaphoric Thinking
      • TRIZ - Problems and Contradictions
      • TRIZ - The Unreasonable Effectiveness of Available Resources
      • TRIZ - The Ideal Final Result
      • TRIZ - A Contradictory Language
      • TRIZ - The Contradiction Matrix Workflow
      • TRIZ - The Laws of Evolution
      • TRIZ - Substance Field Analysis, and ARIZ
    • Math Models in Design
      • Tools and Installation
      • Working with Shape
      • Working with Sound
      • Working with Networks
      • Working with Chance
      • Working with Text
      • Working with Time
      • Working With Thoughts
    • Data Science with No Code
      • Data
      • Orange
      • Summaries
      • Counts
      • Quantity
      • Groups
      • Change
      • Rhythm
      • Proportions
      • Ranking
      • Flow
      • Structure
      • Space
      • Networks
      • Surveys
      • Experiments
    • Literary Jukebox: In Short, the World
      • Italy - Dino Buzzati
      • France - Guy de Maupassant
      • Japan - Hisaye Yamamoto
      • Peru - Ventura Garcia Calderon
      • Russia - Maxim Gorky
      • Egypt - Alifa Rifaat
      • Brazil - Clarice Lispector
      • England - V S Pritchett
      • Russia - Ivan Bunin
      • Czechia - Milan Kundera
      • Sweden - Lars Gustaffsson
      • Canada - John Cheever
      • Ireland - William Trevor
      • USA - Raymond Carver
      • Italy - Primo Levi
      • India - Ruth Prawer Jhabvala
      • USA - Carson McCullers
      • Zimbabwe - Petina Gappah
      • India - Bharati Mukherjee
      • USA - Lucia Berlin
      • USA - Grace Paley
      • England - Angela Carter
      • USA - Kurt Vonnegut
      • Spain-Merce Rodoreda
      • Israel - Ruth Calderon
      • Israel - Etgar Keret
  • Posts
  • Blogs

On this page

  • 1 Slides and Tutorials
  • 2 Setting up R Packages
  • 3 What graphs will we see today?
  • 4 What kind of Data Variables will we choose?
  • 5 Inspiration
    • 5.1 Graphing Packages in R
  • 6 Bar Charts and Histograms
  • 7 How do Bar Chart(s) Work?
  • 8 Case Study-1: Chicago Taxi Rides dataset
    • 8.1 Examine the Data
    • 8.2 Data Dictionary
    • 8.3 Hypothesis and Research Questions
  • 9 Plotting Barcharts
    • 9.1 Data Munging
    • 9.2 Question-1: Do more people tip than not?
    • 9.4 Question-2: Does the tip depend upon whether the trip is local or not?
    • 9.6 Question-3: Do some cab company-ies get more tips than others?
    • 9.8 Question-4: Does a tip depend upon the distance, hour of day, and dow and month?
  • 10 Bar Plot Extras
  • 11 Are the Differences in Proportion Significant?
  • 12 Your Turn
  • 13 Wait, But Why?
  • 14 Conclusion
  • 15 AI Generated Summary and Podcast
  • 16 References
  1. Teaching
  2. Data Analytics for Managers and Peasants
  3. Descriptive Analytics
  4. Counts

Counts

Happy Families are All Alike

Qual Variables
Bar Charts
Column Charts
Author

Arvind V.

Published

June 23, 2024

Modified

September 29, 2024

Abstract
Quant and Qual Variable Graphs and their Siblings

1 Slides and Tutorials

R (Static Viz)   Radiant Tutorial  Datasets

“No matter what happens in life, be good to people. Being good to people is a wonderful legacy to leave behind.”

— Taylor Swift

2 Setting up R Packages

library(tidyverse)
library(mosaic)
library(ggformula)
library(skimr)

3 What graphs will we see today?

Variable #1 Variable #2 Chart Names Chart Shape
Qual None Bar Chart

4 What kind of Data Variables will we choose?

No Pronoun Answer Variable/Scale Example What Operations?
3 How, What Kind, What Sort A Manner / Method, Type or Attribute from a list, with list items in some " order" ( e.g. good, better, improved, best..) Qualitative/Ordinal Socioeconomic status (Low income, Middle income, High income),Education level (HighSchool, BS, MS, PhD),Satisfaction rating(Very much Dislike, Dislike, Neutral, Like, Very Much Like) Median,Percentile

5 Inspiration

Figure 1: Capital Cities

How much does the (financial) capital of a country contribute to its GDP? Which would be India’s city? What would be the reduction in percentage? And these Germans are crazy.(Toc, toc, toc, toc!)

Note how the axis variable that defines the bar locations is a …Qual variable!

5.1 Graphing Packages in R

There are several Data Visualization packages, even systems, within R.

  • Base R supports graph making out of the box;

  • The most well known is ggplot https://ggplot2-book.org/ which uses Leland Wilkinson’s concept of a “Grammar of Graphics”;

  • There is the lattice package https://lattice.r-forge.r-project.org/ which uses the “Trellis Graphics” concept framework for data visualization developed by R. A. Becker, W. S. Cleveland, et al.;

  • And the grid package https://bookdown.org/rdpeng/RProgDA/the-grid-package.html that allows extremely fine control of shapes plotted on the graph.

Each system has its benefits and learning complexities. We will look at plots created using the simpler and intuitive ggformula system that uses the popularggplot framework, but provides a simplified interface that is easy to recall and apply. While our first option will be to use ggformula, we will, where appropriate state ggplot code too for comparison.

A quick reminder on how mosaic and ggformula and ggplot work in a very similar fashion:

mosaic and ggformula command template

Note the standard method for all commands from the mosaic and ggformula packages: goal( y ~ x | z, data = _____)

With mosaic, one can create a statistical correlation test between two variables as: cor_test(y ~ x, data = ______ )

With ggformula, one can create any graph/chart using: gf_***(y ~ x | z, data = _____) In practice, we often use: dataframe %>% gf_***(y ~ x | z) which has cool benefits such as “autocompletion” of variable names, as we shall see. The “***” indicates what kind of graph you desire: histogram, bar, scatter, density; the “___” is the name of your dataset that you want to plot with.

ggplot command template

The ggplot2 template is used to identify the dataframe, identify the x and y axis, and define visualized layers:

ggplot(data = ---, mapping = aes(x = ---, y = ---)) + geom_----()

Note: —- is meant to imply text you supply. e.g. function names, data frame names, variable names.

It is helpful to see the argument mapping, above. In practice, rather than typing the formal arguments, code is typically shorthanded to this:

dataframe %>% ggplot(aes(xvar, yvar)) + geom_----()

6 Bar Charts and Histograms

Bar Charts show counts of observations with respect to a Qualitative variable. For instance, a shop inventory with shirt-sizes. Each bar has a height proportional to the count per shirt-size, in this example.

Although Histograms may look similar to Bar Charts, the two are different. First, histograms show continuous Quant data. By contrast, bar charts show categorical data, such as shirt-sizes, or apples, bananas, carrots, etc. Visually speaking, histograms do not usually show spaces between bars because these are continuous values, while column charts must show spaces to separate each category.

7 How do Bar Chart(s) Work?

Bar are used to show “counts” and “tallies” with respect to Qual variables: they answer the question How Many?. For instance, in a survey, how many people vs Gender? In a Target Audience survey on Weekly Consumption, how many low, medium, or high expenditure people?

Each Qual variable potentially has many levels as we saw in the Nature of Data. For instance, in the above example on Weekly Expenditure, low, medium and high were levels for the Qual variable Expenditure. Bar charts perform internal counts for each level of the Qual variable under consideration. The Bar Plot is then a set of disjoint bars representing these counts; see the icon above, and then that for histograms!! The X-axis is the set of levels in the Qual variable, and the Y-axis represents the counts for each level.

8 Case Study-1: Chicago Taxi Rides dataset

We will first look at at a dataset that speaks about taxi rides in Chicago in the year 2022. This is available on Vincent Arel-Bundock’s superb repository of datasets.Let us read into R directly from the website.

  • R
taxi <- read_csv("https://vincentarelbundock.github.io/Rdatasets/csv/modeldata/taxi.csv")

The data has automatically been read into the webr session, so you can continue on to the next code chunk!

8.1 Examine the Data

As per our Workflow, we will look at the data using all the three methods we have seen.

  • R
  • web-r
glimpse(taxi)
Rows: 10,000
Columns: 8
$ rownames <dbl> 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18…
$ tip      <chr> "yes", "yes", "yes", "yes", "yes", "yes", "yes", "yes", "yes"…
$ distance <dbl> 17.19, 0.88, 18.11, 20.70, 12.23, 0.94, 17.47, 17.67, 1.85, 1…
$ company  <chr> "Chicago Independents", "City Service", "other", "Chicago Ind…
$ local    <chr> "no", "yes", "no", "no", "no", "yes", "no", "no", "no", "no",…
$ dow      <chr> "Thu", "Thu", "Mon", "Mon", "Sun", "Sat", "Fri", "Sun", "Fri"…
$ month    <chr> "Feb", "Mar", "Feb", "Apr", "Mar", "Apr", "Mar", "Jan", "Apr"…
$ hour     <dbl> 16, 8, 18, 8, 21, 23, 12, 6, 12, 14, 18, 11, 12, 19, 17, 13, …
skim(taxi)
Data summary
Name taxi
Number of rows 10000
Number of columns 8
_______________________
Column type frequency:
character 5
numeric 3
________________________
Group variables None

Variable type: character

skim_variable n_missing complete_rate min max empty n_unique whitespace
tip 0 1 2 3 0 2 0
company 0 1 5 28 0 7 0
local 0 1 2 3 0 2 0
dow 0 1 3 3 0 7 0
month 0 1 3 3 0 4 0

Variable type: numeric

skim_variable n_missing complete_rate mean sd p0 p25 p50 p75 p100 hist
rownames 0 1 5000.50 2886.90 1 2500.75 5000.50 7500.25 10000.0 ▇▇▇▇▇
distance 0 1 6.22 7.38 0 0.94 1.78 15.56 42.3 ▇▁▂▁▁
hour 0 1 14.18 4.36 0 11.00 15.00 18.00 23.0 ▁▃▅▇▃
inspect(taxi)

categorical variables:  
     name     class levels     n missing
1     tip character      2 10000       0
2 company character      7 10000       0
3   local character      2 10000       0
4     dow character      7 10000       0
5   month character      4 10000       0
                                   distribution
1 yes (92.1%), no (7.9%)                       
2 other (27.1%) ...                            
3 no (81.2%), yes (18.8%)                      
4 Thu (19.6%), Wed (17.5%), Tue (16.3%) ...    
5 Apr (31.8%), Mar (31.4%), Feb (20.4%) ...    

quantitative variables:  
      name   class min      Q1  median        Q3     max        mean
1 rownames numeric   1 2500.75 5000.50 7500.2500 10000.0 5000.500000
2 distance numeric   0    0.94    1.78   15.5625    42.3    6.224144
3     hour numeric   0   11.00   15.00   18.0000    23.0   14.177300
           sd     n missing
1 2886.895680 10000       0
2    7.381397 10000       0
3    4.359904 10000       0

8.2 Data Dictionary

Business Insights on Examining the taxi dataset
  • This is a large dataset (10K rows), 8 columns/variables.
  • There are several Qualitative variables: tip(2), company(7) and local(2), dow(7), and month(12). These have levels as shown in the parenthesis.
  • Note that hour despite being a discrete/numerical variable, it can be treated as a Categorical variable too.
  • distance is Quantitative.
  • There are no missing values for any variable, all are complete with 10K entries.

8.3 Hypothesis and Research Questions

  • The target variable for an experiment that resulted in this data might be the tip variable. Which is a binary i.e. Yes/No type Qual variable.
Research Questions:
  • Do more people tip than not?
  • Does a tip depend upon whether the trip is local or not?
  • Do some cab company-ies get more tips than others?
  • And does a tip depend upon the distance, hour of day, and dow and month?

Try and think of more Questions!

9 Plotting Barcharts

Let’s plot some bar graphs: recall that for bar charts, we need to choose Qual variables to count with! In each case, we will state a Hypothesis/Question and try to answer it with a chart.

9.1 Data Munging

We will keep the target variable tip in mind at all times. And convert the dow, local and month variables into factors beforehand.

## Convert `dow`, `local`, and `month` into ordered factors
taxi_modified <- taxi %>%
  mutate(
    dow = factor(dow,
      levels = c("Mon", "Tue", "Wed", "Thu", "Fri", "Sat", "Sun"),
      labels = c("Mon", "Tue", "Wed", "Thu", "Fri", "Sat", "Sun"),
      ordered = TRUE
    ),
    ##
    local = factor(local,
      levels = c("no", "yes"),
      labels = c("no", "yes"),
      ordered = TRUE
    ),
    ##
    month = factor(month,
      levels = c("Jan", "Feb", "Mar", "Apr"),
      labels = c("Jan", "Feb", "Mar", "Apr"),
      ordered = TRUE
    )
  )
taxi_modified %>% glimpse()
Rows: 10,000
Columns: 8
$ rownames <dbl> 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18…
$ tip      <chr> "yes", "yes", "yes", "yes", "yes", "yes", "yes", "yes", "yes"…
$ distance <dbl> 17.19, 0.88, 18.11, 20.70, 12.23, 0.94, 17.47, 17.67, 1.85, 1…
$ company  <chr> "Chicago Independents", "City Service", "other", "Chicago Ind…
$ local    <ord> no, yes, no, no, no, yes, no, no, no, no, no, no, no, yes, no…
$ dow      <ord> Thu, Thu, Mon, Mon, Sun, Sat, Fri, Sun, Fri, Tue, Tue, Sun, W…
$ month    <ord> Feb, Mar, Feb, Apr, Mar, Apr, Mar, Jan, Apr, Mar, Mar, Apr, A…
$ hour     <dbl> 16, 8, 18, 8, 21, 23, 12, 6, 12, 14, 18, 11, 12, 19, 17, 13, …

9.2 Question-1: Do more people tip than not?

Question-1: Do more people tip than not?
  • Using ggformula
  • Using ggplot
  • web-r
## Set graph theme
theme_set(new = theme_custom())
##

gf_bar(~tip, data = taxi_modified) %>%
  gf_labs(title = "Plot 1A: Counts of Tips")

## Set graph theme
theme_set(new = theme_custom())
##
ggplot(taxi_modified) +
  geom_bar(aes(x = tip)) +
  labs(title = "Plot 1A: Counts of Tips")

9.3 Business Insights-1

  • Far more people tip than not.
  • (Future) The counts of tip are very imbalanced and if we are to setup a model for that (e.g. logistic regression) we would need to very carefully subset the data for training and testing our model.

9.4 Question-2: Does the tip depend upon whether the trip is local or not?

Question-2: Does the tip depend upon whether the trip is local or not?
  • Using ggformula
  • Using ggplot
  • web-r
## Set graph theme
theme_set(new = theme_custom())
##
taxi_modified %>%
  gf_bar(~local,
    fill = ~tip,
    position = "dodge"
  ) %>%
  gf_labs(title = "Plot 2A: Dodged Bar Chart")

## Set graph theme
theme_set(new = theme_custom())
##
taxi_modified %>%
  gf_bar(~local,
    fill = ~tip,
    position = "stack"
  ) %>%
  gf_labs(
    title = "Plot 2B: Stacked Bar Chart",
    subtitle = "Can we spot per group differences in proportions??"
  )

## Set graph theme
theme_set(new = theme_custom())
##
## Showing "per capita" percentages
taxi_modified %>%
  gf_bar(~local,
    fill = ~tip,
    position = "fill"
  ) %>%
  gf_labs(
    title = "Plot 2C: Filled Bar Chart",
    subtitle = "Shows Per group differences in Proportions!"
  )

## Set graph theme
theme_set(new = theme_custom())
##
## Showing "per capita" percentages
## Better labelling of Y-axis
taxi_modified %>%
  gf_props(~local,
    fill = ~tip,
    position = "fill"
  ) %>%
  gf_labs(
    title = "Plot 2D: Filled Bar Chart",
    subtitle = "Shows Per group differences in Proportions!"
  )

## Set graph theme
theme_set(new = theme_custom())
##
taxi_modified %>%
  ggplot() +
  geom_bar(aes(x = local, fill = tip), position = "dodge") +
  labs(title = "Plot 2A:Dodged Bar Chart")
##
taxi_modified %>%
  ggplot() +
  geom_bar(aes(x = local, fill = tip), position = "stack") +
  labs(title = "Plot 2B: Stacked Bar Chart", subtitle = "Can we spot per group differences in proportions??")
## Showing "per capita" percentages
taxi_modified %>%
  ggplot() +
  geom_bar(aes(x = local, fill = tip), position = "fill") +
  labs(title = "Plot 2C: Filled Bar Chart", subtitle = "Shows Per group differences in Proportions!")
## Showing "per capita" percentages
## Better labelling of Y-axis
taxi_modified %>%
  ggplot() +
  geom_bar(aes(x = local, fill = tip), position = "fill") +
  labs(
    title = "Plot 2D: Filled Bar Chart", subtitle = "Shows Per group differences in Proportions!",
    y = "Proportion"
  )

9.5 Business Insights-2

  • Counting the frequency of tip by local gives us grouped counts, but we cannot tell the percentage per group (local or not) of those who tip and those who do not.
  • We need per-group percentages because the number of local trips are not balanced
  • Hence we tried bar charts with position = stack, but finally it is the position = fill that works best.
  • We see that the percentage of tippers is somewhat higher with people who make non-local trips. Not surprising.

9.6 Question-3: Do some cab company-ies get more tips than others?

Question-3: Do some cab company-ies get more tips than others?
  • Using ggformula
  • Using ggplot
  • web-r
## Set graph theme
theme_set(new = theme_custom())
##
taxi_modified %>%
  gf_bar(~company, fill = ~tip, position = "dodge") %>%
  gf_labs(title = "Plot 2A: Dodged Bar Chart") %>%
  gf_theme(theme(axis.text.x = element_text(size = 6, angle = 45, hjust = 1)))

## Set graph theme
theme_set(new = theme_custom())
#
taxi_modified %>%
  gf_bar(~company, fill = ~tip, position = "stack") %>%
  gf_labs(
    title = "Plot 2B: Stacked Bar Chart",
    subtitle = "Can we spot per group differences in proportions??"
  ) %>%
  gf_theme(theme(axis.text.x = element_text(size = 6, angle = 45, hjust = 1)))

## Set graph theme
theme_set(new = theme_custom())
#
## Showing "per capita" percentages
taxi_modified %>%
  gf_bar(~company, fill = ~tip, position = "fill") %>%
  gf_labs(
    title = "Plot 2C: Filled Bar Chart",
    subtitle = "Shows Per group differences in Proportions!"
  ) %>%
  gf_theme(theme(axis.text.x = element_text(size = 6, angle = 45, hjust = 1)))

## Set graph theme
theme_set(new = theme_custom())
#
## Showing "per capita" percentages
## Better labelling of Y-axis
taxi_modified %>%
  gf_props(~company, fill = ~tip, position = "fill") %>%
  gf_labs(
    title = "Plot 2D: Filled Bar Chart",
    subtitle = "Shows Per group differences in Proportions!"
  ) %>%
  gf_theme(theme(axis.text.x = element_text(size = 6, angle = 45, hjust = 1)))

## Set graph theme
theme_set(new = theme_custom())
##
taxi_modified %>%
  ggplot() +
  geom_bar(aes(x = company, fill = tip), position = "dodge") +
  labs(title = "Plot 2A: Dodged Bar Chart") +
  theme(theme(axis.text.x = element_text(size = 6, angle = 45, hjust = 1)))
##
taxi_modified %>%
  ggplot() +
  geom_bar(aes(x = company, fill = tip), position = "stack") +
  labs(
    title = "Plot 2B: Stacked Bar Chart",
    subtitle = "Can we spot per group differences in proportions??"
  ) +
  theme(theme(axis.text.x = element_text(size = 6, angle = 45, hjust = 1)))
## Showing "per capita" percentages
taxi_modified %>%
  ggplot() +
  geom_bar(aes(x = company, fill = tip), position = "fill") +
  labs(
    title = "Plot 2C: Filled Bar Chart",
    subtitle = "Shows Per group differences in Proportions!"
  ) +
  theme(theme(axis.text.x = element_text(size = 6, angle = 45, hjust = 1)))
## Showing "per capita" percentages
## Better labelling of Y-axis
taxi_modified %>%
  ggplot() +
  geom_bar(aes(x = company, fill = tip), position = "fill") +
  labs(
    title = "Plot 2D: Filled Bar Chart",
    subtitle = "Shows Per group differences in Proportions!",
    y = "Proportions"
  ) +
  theme(theme(axis.text.x = element_text(size = 6, angle = 45, hjust = 1)))

9.7 Business Insights-3

  • Using stack, dodge, and fill in bar plots gives us different ways of looking at the sets of counts;
  • fill: gives us a per-group proportion of another Qual variable for a chosen Qual variable. This chart view is useful in Inference for Proportions;
  • Most cab company-ies have similar usage, if you neglect the other category of company;
  • Does seem that of all the company-ies, tips are not so good for the Flash Cab company. A driver issue? Or are the cars too old? Or don’t they offer service everywhere?

9.8 Question-4: Does a tip depend upon the distance, hour of day, and dow and month?

Question-4: Does a tip depend upon the distance, hour of day, and dow and month?
  • Using ggformula
  • Using ggplot
  • web-r
## Set graph theme
theme_set(new = theme_custom())
##
gf_bar(~hour, fill = ~tip, data = taxi_modified) %>%
  gf_labs(title = "Plot B: Counts of Tips by Hour")

##
gf_bar(~dow, fill = ~tip, data = taxi_modified) %>%
  gf_labs(title = "Plot C: Counts of Tips by Day of Week")

##
gf_bar(~month, fill = ~tip, data = taxi_modified) %>%
  gf_labs(title = "Plot D: Counts of Tips by Month")

##
gf_bar(~ month | dow, fill = ~tip, data = taxi_modified) %>%
  gf_labs(title = "Plot E: Counts of Tips by Day of Week and Month")

##
## This may be too busy a graph...
gf_bar(~ dow | hour, fill = ~tip, data = taxi_modified) %>%
  gf_labs(
    title = "Plot F: Counts of Tips by Hour and Day of Week",
    subtitle = "Is this plot arrangement easy to grasp?"
  )

## This is better!
gf_bar(~ hour | dow, fill = ~tip, data = taxi_modified) %>%
  gf_labs(
    title = "Plot G: Counts of Tips by Hour and Day of Week",
    subtitle = "Swapped the Facets"
  )

## Set graph theme
theme_set(new = theme_custom())
##
ggplot(data = taxi_modified) +
  geom_bar(aes(x = tip)) +
  facet_wrap(vars(hour)) +
  labs(title = "Plot B: Counts of Tips by Hour")
##
ggplot(data = taxi_modified) +
  geom_bar(aes(x = tip)) +
  facet_wrap(vars(dow)) +
  labs(title = "Plot C: Counts of Tips by Day of Week")
##
ggplot(data = taxi_modified) +
  geom_bar(aes(x = tip)) +
  facet_wrap(vars(month)) +
  labs(title = "Plot D: Counts of Tips by Month")
##
ggplot(data = taxi_modified) +
  geom_bar(aes(x = tip)) +
  facet_grid(rows = vars(dow), cols = vars(month)) +
  labs(title = "Plot E: Counts of Tips by Day of Week and Month")
##
## This may be too busy a graph...
ggplot(data = taxi_modified) +
  geom_bar(aes(x = dow, fill = tip)) +
  facet_wrap(vars(hour)) +
  labs(
    title = "Plot F: Counts of Tips by Hour and Day of Week",
    subtitle = "Is this plot arrangement easy to grasp?"
  )
## This is better!
ggplot(data = taxi_modified) +
  geom_bar(aes(x = hour, fill = tip)) +
  facet_wrap(vars(dow)) +
  labs(
    title = "Plot G: Counts of Tips by Hour and Day of Week",
    subtitle = "Swapped the Facets"
  )

9.9 Business Insights-4

  • Note: We were using fill = ~ tip here! Why is that a good idea?
  • tips vs hour: There are always more people who tip than those who do not. Of course there are fewer trips during the early morning hours and the late night hours, based on the very small bar-pairs we see at those times
  • tips vs dow: Except for Sunday, the tip count patterns (Yes/No) look similar across all days.
  • tips vs month: We have data for 4 months only. Again, the tip count patterns (Yes/No) look similar across all months. Perhaps slightly fewer trips in Jan, when it is cold in Chicago and people may not go out much.
  • tips vs dow vs month: Very similar counts for tips(Yes/No) across day-of-week and month.

10 Bar Plot Extras

gf-bar and gf-col

Note also that gf_bar/geom_bar takes only ONE variable (for the x-axis), whereas gf_col/geom_col needs both X and Y variables since it simply plots columns. Both are useful!

And we can plot Proportions and Percentages too!

We have already seen gf_props in our two case studies above. Also check out gf_percents ! These are both very useful ggformula functions!

## Set graph theme
theme_set(new = theme_custom())
##

gf_props(~substance,
  data = mosaicData::HELPrct, fill = ~sex,
  position = "dodge"
) %>%
  gf_labs(title = "Plotting Proportions using gf_props")

## Set graph theme
theme_set(new = theme_custom())
##

gf_props(~substance,
  data = mosaicData::HELPrct, fill = ~sex,
  position = "fill"
) %>% 
  gf_labs(title = "Plotting Proportions using gf_props")

gf_percents(~substance,
  data = mosaicData::HELPrct, fill = ~sex,
  position = "dodge"
) %>%
  gf_refine(
    scale_y_continuous(
      labels = scales::label_percent(scale = 1)
    )
  ) %>%
  gf_labs(title = "Plotting Percentages using gf_percents")

11 Are the Differences in Proportion Significant?

When we see situations such as this, where data has one or more Qual variables that are binary(Yes/No), we are always interested in whether these proportions of Yes/No are really different, or if we are just seeing the result of random chance. This is usually mechanized by a Stat Test called a Single Proportion Test or, when we have more than one, a Multiple Proportion Test.

12 Your Turn

Datasets

  1. Click on the Dataset Icon above, and unzip that archive. Try to make Bar plots with each of them, using one or more Qual variables.

  2. A dataset from calmcode.io https://calmcode.io/datasets.html

  1. AiRbnb Price Data on the French Riviera:
  1. Apartment price vs ground living area:


  1. Fertility: This rather large and interesting Fertility related dataset from https://vincentarelbundock.github.io/Rdatasets/csv/AER/Fertility.csv

glimpse / skim / inspect the dataset in each case, state that Data Dictionary, and develop a set of Questions that can be answered by appropriate stat measures, or by using a chart to show the distribution.

13 Wait, But Why?

  • Always count your chickens count your data before you model or infer!
  • Counts first give you an absolute sense of how much data you have.
  • Counts by different Qual variables give you a sense of the combinations you have in your data: \((Male/Female) * (Income-Status) * (Old/Young) * (Urban/Rural)\) (Say 2 * 3 * 2 * 2 = 24 combinations of data)
  • Counts then give an idea whether your data is lop-sided: do you have too many observations of one category(level) and too few of another category(level) in a given Qual variable?
  • Balance is important in order to draw decent inferences
  • And for ML algorithms, to train them properly.
  • Since the X-axis in bar charts is Qualitative (the bars don’t touch, remember!) it is possible to sort the bars at will, based on the levels within the Qualitative variables. See the approx Zipf’s Law distribution for the English alphabet below:
Figure 2: Zipf’s Law

In Figure 2, the letters of the alphabet are “levels” within a Qualitative variable, and these levels have been sorted based on the frequency or count! This is what Sherlock Holmes might have done, or the method how they cracked the code to the treasure in this story.

14 Conclusion

  • Qualitative data variables can be plotted as counts, using Bar Charts
  • gf_col and gf_bar provide Bar charts; gf_bar performs counts internally, whereas gf_col requires pre-counted data.
  • Using facets allows us to view counts of one Qual variable split over two other Qual variables

15 AI Generated Summary and Podcast

This text excerpt focuses on bar charts and histograms as visualization tools for qualitative and quantitative data, respectively. It walks the reader through the creation of bar charts using the R programming language, illustrating the concept through a case study using the Chicago taxi rides dataset. The author explores various scenarios and questions related to taxi tipping, such as the frequency of tips and their dependence on trip locality, company, hour of the day, and day of the week. Finally, the excerpt highlights the importance of understanding data counts before undertaking data modeling or inference, emphasizing the role of bar charts in revealing data distribution and potential imbalances.

Your browser does not support the audio tag; for browser support, please see: https://www.w3schools.com/tags/tag_audio.asp

x

16 References

  1. Daniel Kaplan and Randall Pruim. ggformula: Formula Interface for ggplot2 (full version). https://www.mosaic-web.org/ggformula/articles/pkgdown/ggformula-long.html
R Package Citations
Package Version Citation
ggformula 0.12.0 Kaplan and Pruim (2023)
mosaic 1.9.1 Pruim, Kaplan, and Horton (2017)
tidyverse 2.0.0 Wickham et al. (2019)
Kaplan, Daniel, and Randall Pruim. 2023. ggformula: Formula Interface to the Grammar of Graphics. https://CRAN.R-project.org/package=ggformula.
Pruim, Randall, Daniel T Kaplan, and Nicholas J Horton. 2017. “The Mosaic Package: Helping Students to ‘Think with Data’ Using r.” The R Journal 9 (1): 77–102. https://journal.r-project.org/archive/2017/RJ-2017-024/index.html.
Wickham, Hadley, Mara Averick, Jennifer Bryan, Winston Chang, Lucy D’Agostino McGowan, Romain François, Garrett Grolemund, et al. 2019. “Welcome to the tidyverse.” Journal of Open Source Software 4 (43): 1686. https://doi.org/10.21105/joss.01686.
Back to top

Citation

BibTeX citation:
@online{v.2024,
  author = {V., Arvind},
  title = {\textless Iconify-Icon Icon=“eos-Icons:counting”
    Width=“1.2em”
    Height=“1.2em”\textgreater\textless/Iconify-Icon\textgreater{}
    {Counts}},
  date = {2024-06-23},
  url = {https://av-quarto.netlify.app/content/courses/Analytics/Descriptive/Modules/20-BarPlots/},
  langid = {en},
  abstract = {Quant and Qual Variable Graphs and their Siblings}
}
For attribution, please cite this work as:
V., Arvind. 2024. “<Iconify-Icon Icon=‘eos-Icons:counting’ Width=‘1.2em’ Height=‘1.2em’></Iconify-Icon> Counts.” June 23, 2024. https://av-quarto.netlify.app/content/courses/Analytics/Descriptive/Modules/20-BarPlots/.
Summaries
Quantities

License: CC BY-SA 2.0

Website made with ❤️ and Quarto, by Arvind V.

Hosted by Netlify .